Memory formation and recall in recurrent spiking neural networks

نویسندگان

  • Friedemann ZENKE
  • Stefano Fusi
  • Walter Senn
چکیده

Our brain has the capacity to analyze a visual scene in a split second, to learn how to play an instrument, and to remember events, faces and concepts. Neurons underlie all of these diverse functions. Neurons, cells within the brain that generate and transmit electrical activity, communicate with each other through chemical synapses. These synaptic connections dynamically change with experience, a process referred to as synaptic plasticity. These synaptic changes are thought to be at the core of the brain’s ability to learn and process the world in sophisticated ways. Our understanding of the rules of synaptic plasticity remain quite limited. To enable efficient computations among neurons or to serve as a trace of memory, synapses must create stable connectivity patterns between neurons. However there remains an insufficient theoretical explanation as to how stable connectivity patterns can exist in the presence of synaptic plasticity. What complicates and limits our understanding is that the dynamics of recurrently connected neurons depend upon their connections, which themselves change in response to the network dynamics. The recursive nature of the problem necessitates that the network connectivity and the synaptic plasticity be treated as a single compound system. Due to the nonlinear nature of the problem this quickly becomes analytically challenging. Utilizing network simulations that model the interplay between the network connectivity and synaptic plasticity can provide insight into this problem. However, most existing network models that implement biologically relevant forms of plasticity become unstable, developing seizure like activity. This suggests that these models do not accurately describe the biological networks, which have no difficulty functioning without succumbing to exploding network activity. The instability in these network simulations could originate from the fact that theoretical studies have, almost exclusively, focused on Hebbian plasticity at excitatory synapses. Hebbian plasticity causes connected neurons that are active together to increase the connection strength between them. Biological networks, however, display a large variety of different forms of synaptic plasticity and homeostatic mechanisms, beyond Hebbian plasticity. Furthermore, inhibitory cells can undergo synaptic plasticity as well. These diverse forms of plasticity are active at the same time, and our un-

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks

Synaptic plasticity, the putative basis of learning and memory formation, manifests in various forms and across different timescales. Here we show that the interaction of Hebbian homosynaptic plasticity with rapid non-Hebbian heterosynaptic plasticity is, when complemented with slower homeostatic changes and consolidation, sufficient for assembly formation and memory recall in a spiking recurre...

متن کامل

Attractor networks and memory replay of phase coded spike patterns

We analyse the storage and retrieval capacity in a recurrent neural network of spiking integrate and fire neurons. In the model we distinguish between a learning mode, during which the synaptic connections change according to a SpikeTiming Dependent Plasticity (STDP) rule, and a recall mode, in which connections strengths are no more plastic. Our findings show the ability of the network to stor...

متن کامل

Associative Memory Models of Hippocampal Areas CA1 and CA3

The hippocampal regions CA3 and CA1 have long been proposed to be autoand heteroassociative memories, respectively (Marr, 1971; McNaughton and Morris, 1987; Treves and Rolls, 1994), for the storage of declarative information. An autoassociative memory is formed when a set of neurons are recurrently connected by modifiable synapses, whereas a heteroassociative memory is formed through modifiable...

متن کامل

Learning Beyond Finite Memory in Recurrent Networks of Spiking Neurons

We investigate possibilities of inducing temporal structures without fading memory in recurrent networks of spiking neurons strictly operating in the pulse-coding regime. We extend the existing gradient-based algorithm for training feedforward spiking neuron networks, SpikeProp (Bohte, Kok, & La Poutré, 2002), to recurrent network topologies, so that temporal dependencies in the input stream ar...

متن کامل

Learning to Generate Sequences with Combination of Hebbian and Non-hebbian Plasticity in Recurrent Spiking Neural Networks

Synaptic Plasticity, the foundation for learning and memory formation in the human brain, manifests in various forms. Here, we combine the standard spike timing correlation based Hebbian plasticity with a non-Hebbian synaptic decay mechanism for training a recurrent spiking neural model to generate sequences. We show that inclusion of the adaptive decay of synaptic weights with standard STDP he...

متن کامل

Sequence Learning and Planning on Associative Spiking Neural Network

We have been building an auto/heteroassociative spiking neural network combined with a working memory model. In this model, a statedriven forward sequence and a goal-driven backward sequence on the associative network are respectively represented by a sequence of synchronous firing in a particular gamma subcycle during a theta oscillation. These forward and backward sequence firings are transmi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2014